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A three-color pyrometer has been developed based on plenoptic imaging technology. 
Three bandpass filters placed in front of a camera lens allow separate 2D images to be 
obtained on a single image sensor at three different and adjustable wavelengths selected by 
the user. Images were obtained of different black- or grey-bodies including a calibration 
furnace, a radiation heater, and a luminous sulfur match flame. The images obtained of the 
calibration furnace and radiation heater were processed to determine 2D temperature 
distributions. Calibration results in the furnace showed that the instrument can measure 
temperature with an accuracy and precision of 10 Kelvins between 1100 and 1350 K. Time- 
resolved 2D temperature measurements of the radiation heater are shown. 


I. Introduction 


Or pyrometry — the use of an optical instrument to remotely measure temperature — has been used in 
countless applications where the light emission from a hot object is collected by a sensor and processed to 
measure temperature. Many commercially available pyrometers measure temperature at a single point.! Such 
instruments can view the absolute intensity of the radiation at one or more wavelengths to determine the 
temperature. Some single-point instruments collect and disperse a wide range of the visible or infrared spectrum. 
Instruments that measure a wide spectral range collect more information about the radiation and can therefore be 
more reliable and accurate than simple one- or two-color pyrometers. Some instruments, typically near-infrared or 
mid-infrared cameras, measure two dimensional (2D) temperature distributions, usually by imaging a single color or 
wavelength band of radiation. While these instruments are very sensitive to relative changes in temperature, they 
can be difficult to calibrate and are susceptible to errors caused by changes in emissivity, surface finish, composition 
or phase change, transmission losses or absorption interferences since they rely on absolute intensity measurements. ! 
Hybrid instruments, for example, where a 2D camera is placed at the exit of an imaging spectrometer, can be used to 
measure fully resolved spectra at each point along a 1D line. The spectral resolution of such systems is 
advantageous because the full spectrum can be analyzed at each point and the temperature determined from the 
relative shape of the spectra. In such systems, interferences can be readily identified and avoided, but 2D spatial 
information is not obtained. 

Some fully 2D, spectrally resolved systems exist as reviewed by Hagen and Kudenov.” These systems are 
sometimes termed multi-spectral or hyperspectral imaging systems. Such systems have previously been used for 
optical pyrometry including three-color 2D imaging systems.* Many of these optical systems which can provide 2D 
images at multiple wavelengths use beam splitters or other optical elements and are cumbersome, growing in size as 
more wavelengths are added. An alternate method is to mount filters on a mechanical disk (called a filter wheel) and 
these filters are sequentially rotated in front in a camera to acquire images at different wavelengths. Such filter- 
wheel systems have several drawbacks: this bulky arrangement has moving parts which can fail, the images are 
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taken at different times, slowing data acquisition and preventing capture of transient events. This paper describes an 
alternative imaging technology known as a plenoptic imager, coupled with spectral filters*> to perform pyrometry. 

A plenoptic camera is similar to a conventional greyscale camera except that a thin microlens array is placed in 
front of the sensor.’ The use of the microlens array allows measurement of additional information about the light 
collected by the primary lens including the angle of the incident rays as well as the intensity. This additional 
information allows ranging information to be obtained. That is, a single camera view can be used to localize 
objects, such as particles in volume of gas. Consequently, plenoptic camera technology has recently been 
investigated for aerospace instrumentation including particle image velocimetry (PIV)* and background oriented 
schlieren (BOS).? Using conventional cameras in such applications, multiple cameras are used to obtain 3D 
information. Using plenoptic camera technology, hundreds of different ‘views’ are obtained by a single camera so 
that volumetric measurement that previously required many cameras can potentially be performed with just one (or 
two if highly spatially resolved measurement is required). These multiple views greatly simplify experimental 
setups, though the analysis of such data is computationally intensive. This paper describes the use of a plenoptic 
camera for optical pyrometry for the first time. 


II. Apparatus 


Figure 1 shows the schematic of the setup used for the experiment. A conventional 135 mm focal length lens 

was used to image a heated object, which was either a calibration furnace, a radiation heater or a lighted match. The 
lens focused light onto a microlens array which then focuses onto a CCD sensor.'® Briefly summarizing the camera 
specifications, the 29 MPix Bobcat 6620 Imperx camera had a 471 x 362 microlens array arranged in a hexagonal 
pattern. Each microlens had a 
focal length of 308 microns and 
a pitch of 77 microns. The 
microlens array was positioned 
at approximately one microlens 
focal length in front of the image Object 
sensor. As such, each microlens 
image is focused on the main 
lens aperture, which is 
effectively at infinite distance 
(135+ mm) compared to the 
focal length of the microlens. A 
series of three bandpass filters Figure 1. Detailed schematic of setup in the test section, as viewed from the top. The 
were placed in front of the sample is an end-on cylinder. 
camera lens (see also Fig. 2). 
The filters, centered at 800 nm, 632 nm and 550 nm, were mounted in an opaque mount so that all the light hitting 
the sensor passed through one of the three filters. The three filters had 40 nm, 10 nm and 40 nm bandwidths, 
respectively. A neutral density (ND) 0.6 filter was placed on the 800 nm channel to attenuate that channel and 
prevent saturation of the camera, allowing longer exposure times to be acquired to obtain better balance between all 
three channels, thus improving signal-to-noise 
ratio on the red and green channels. 

As shown in Fig. 1, light rays emitted from 
one point on the object images to different 
positions on the CCD camera when passing 
through the different colored filters. On a 
conventional camera, all of these light rays 
would be coincident on a single pixel and 
spectral information would be lost. But with a 
plenoptic camera the different colors are 
spatially separated on the sensor, allowing 
measurement of the intensity emitted by the 
object at different wavelengths. f . 

The main camera lens was manually Figure 2. Image of the three bandpass filters in their mount (left) and 
adjusted to bring the object as viewed through mounted in front of the camera (right). The dashed white circles show 
the relative size~ of the camera lens aperture at f/2 (outer circle) and f/4 
(inner circle). Measurements were performed using f/4. 
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the lens array, into focus on the sensor. In 


principle the refocusing property® of plenoptic cameras could be used to image objects that are not in the nominal 
focal plane. The system could also potentially provide range information to determine the location of the object(s) 
being imaged in addition to temperature. However in the current experiment this range measurement was not done. 
Furthermore, in the present experiment, just three filters were used, but in principle many more filters could be used 
to obtain more colors simultaneously. This simplicity in obtaining many colors simultaneously with a compact 
camera/filter arrangement is a significant advantage of the plenoptic pyrometer compared to the state of the art 
imaging pyrometry methods. 
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Figure 3. Plenoptic spectral images showing images obtained of a burning match. 


Sample images obtained with this apparatus are shown in Fig. 3. The left panel shows the emission from a 
burning match imaged through the instrument with the filters in place. The intensity has been enhanced in the left 
panel image to show the shape of the flame. The match head can be faintly seen towards at the bottom of this 
image. The second panel shows the same data scaled so that the color table is not saturated. The third panel shows 
a magnified view of the second panel and finally the right-most panel shows an even more magnified view. The 
yellow circle highlights an image 
formed by a single micro lens. 


Figure 4 compares a_ highly 
magnified plenoptic camera image 
with (left) and without (right) the 
bandpass filters present. The filter 
wavelengths are indicated on the left 
figure. If the aperture was opened 
further (say from f/4 to f/2) then the 
circular microlens images would 
overlap, rendering the images 
uninterpretable. This prevented 
detection of light through the full 
diameter of the bandpass filters shown 
in Fig. 2. 

The linearity of the camera’s response was measured by observing a constant intensity source and varying the 
duration of the camera exposure. The response was found to be nonlinear. Such nonlinearity can occur because of 
camera gain and lookup table settings according to the manufacturer.'' Figure 5[a] shows that it appears to be 
roughly logarithmic (or sqrt(x) type behavior, reminiscent of a gamma correction used in image processing), with a 
response that rolls off as the exposure time (corresponding to the number of incident photons in a single exposure) 
increases. A power law fit is shown with a dashed line, though it does not fit the data well. A 6" order polynomial 
fit shown as a solid line going through the points obtains an improved fit to the measured data. In order to correct 
for this nonlinearity a function was needed to convert the measured counts to a corrected intensity value. 
Consequently, the axes on the graph were flipped and graphed on a log-log scale in Fig. 5[b]. Again a 6" order 
polynomial was fit to the data, producing an acceptable fit. The resulting polynomial shown in the figure was later 


Figure 4. Comparison of images with (left) and without (right) spectral filters. 
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used to convert measured counts to corrected, linearized, counts (assuming that the incident light is linear with 
exposure time). Note that the detector’s nonlinear response is advantageous in this experiment because it helps 
extend the camera’s dynamic range compared to a detector with a linear response. 
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Figure 5. Camera linearity test results showing camera counts versus exposure time (left) and fit to the same data with axes 
reversed. Note linear scale on [a] and log-log scale on [b]. 


Ill. Calibration and Verification 


A Mikron M360 furnace was used as a variable- 
temperature blackbody light source for calibration. 
The design of the light source produces an effective 
emissivity near unity (specified by the manufacturer 
to be 0.995). The furnace has a maximum operating 
temperature of 1100 °C (1373 K) but the maximum 
temperature used in this experiment was 1050 °C 
(1323 K). The uniformity of the 25 mm diameter 
exit is within 0.1% of the control setting according 
to the manufacturer. Its accuracy is +1 °C, and its 
calibration was current. 

Measurement in the furnace were obtained for 
every 50 K from 973 K to 1323 K. Different Oh 
exposure times were used at each temperature to 
utilize the full dynamic range of the camera. 

Exposure times varied from 1.5 msec to 0.4 sec, 

depending on the temperature. The mean signal 

intensity on each of the three color channels was Figure 6. Intensity measured on each of the spectral channels as a 
corrected for exposure time and camera nonlinearity —_ function of temperature, fitted with power law equations. 
resulting in Fig. 6. Note that the 800 nm channel 

has significantly higher signal compared to the others despite having an additional ND filter in series. The 632 nm 
intensity is not as high as might be expected in comparison with the other two because it has a 4-times narrower 
spectral bandpass width compared to the others. 

It is remarkable that the power law fits show temperature exponents ranging from 16 to 21, which is much larger 
than the T* dependence predicted by Planck’s law. Of course, Planck’s law includes the radiation integrated over all 
wavelengths. The present measurement only detects specific wavelengths. So these curves include not only the 
overall T+ dependence but also the fact that the entire spectrum is shifting to the blue as the temperature increases. 

In the subsequent analysis only the data obtained with the 800 nm and 550 nm filters were utilized because this 
pair of wavelengths (being widely separated in wavelength) is the most temperature-sensitive of those tested. 
Emission collected at these two colors is shown in comparison with the predicted emission at these wavelengths 
using Planck’s law in Fig. 7. While a single scaling constant has been freely adjusted for best fit, the curvature of 
the solid line is determined a priori using Planck’s law evaluated at the wavelength and temperatures shown. The 
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agreement for the 800 nm radiation is good over the full range of temperatures. For the green channel, the 
agreement at high temperatures is good. At lower temperatures, ambient light appears to be interfering with the 550 
nm channel. Consequently, temperature measurements below about 1100 K obtained with this system are expected 
to show a systematic error. 

Ratios of the data points in Fig. 7 were obtained and graphed versus temperature in Fig. 8 with temperature on 
the vertical axis. Thus, a power law fit could be used to develop a simple relationship between measured signal 
intensity ratios and temperature. The resulting fit, shown as a dashed line, passes closely through the data. 
However, the data obtained in subsequent experiments was expected to exceed the temperature range of the 
calibration so the validity of an extrapolation was investigated. For comparison, Planck’s law, valid over a wide 
temperature range, was used to compute the ratio of emission at the two colors as a function of temperature (by 
taking the ratio of the smooth curves in Fig. 7). This curve does not pass as well through the data, perhaps because 
of the room light interference at low temperatures. However both curves extrapolate similarly to higher 
temperatures indicating that either curve would provide similar results at higher temperatures. 
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applied to the fits to calibrate the relative efficiency of the 
two filters. 


After establishing a method and equations for determining temperatures from the plenoptic spectral images, the 
original calibration data was re-fit to determine two-dimensional temperature distributions, allowing determination 
of the measurement accuracy (compared to the known temperature) and precision (1-o variation of the temperature 
within the image of the uniform-temperature calibration source). Based on this secondary analysis, the system is 
expected to reliably measure temperatures above 1100 K with both an accuracy and precision of 10 K, neglecting 
potentially significant errors associate with emissivity, which can vary with wavelength and temperature. 


IV. Processing of Plenoptic Images 


The above analyses were obtained on raw plenoptic images like those shown in Fig. 3 after being corrected for 
nonlinearity and background subtraction. The imaging results shown below were obtained after post-processing the 
images with Auburn University’s LFIT software,!? which is written in Matlab™. Only the microlens calibration and 
perspective view features of the software were used. A single pixel in each of the three regions shown inside the 
yellow circle in Fig. 4 were chosen for analysis. Unfortunately, since these regions were near the edge of the lens 
array image, some artifacts resulting from image reconstruction were observed in the processed images. Since these 
artifacts were very repeatable (they are a function of the camera and microlens setup) they could be normalized out 
by looking at a uniform light source (in this case, the calibration furnace). This normalization was only performed 
once and was applied to all the rest of the images obtained in the experiment. The uniform light source had a circular 
aperture of 25.4 mm diameter, so the correction could only be applied to data falling within this aperture. 

After the images at specific wavelengths were obtained, they were further processed by the ImageJ software in a 
custom-written program.'? This program performed a nonlinearity correction and background subtraction and then 
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the artifact correction normalization was applied. Finally, ratios of the 800 nm and 550 nm images were taken and 
the temperature was determined from the blackbody theory curve drawn in Fig. 8. 


V. Sample Application 


The plenoptic imaging pyrometer has been used to study an unknown temperature object as proof of concept. 
We obtained images of a ceramic radiation heater during steady operation and then suddenly switched off the heater. 
The camera acquired data at about 3 Hz, so the cooldown of the heater could be monitored. The radiation heater is 
shown to operate at a steady temperature for the first 15 frames (about 5 seconds) followed by a cooldown period 
(Figs. 9 and 10). The signal-to-noise ratio in the temperature measurements is high when the heater is operating, but 
once the temperature drops below about 1100 K (frame 35) the signal-to-noise ratio deteriorates, mainly because of 
low signal in the 550-nm channel. It is evident that the dynamic range of the measurement could be improved by 
either using additional colored filters or by using a detector with a larger dynamic range. 
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To demonstrate the sensitively of the lnsirEment, Fig. uniform region in the middle of the heating element in 
11[b] shows a line plot of the region highlighted in Fig. Fig. 9 and graphed versus frame number (acquired at 3 
11[a]. Spatial variations of ~20 degrees are clearly observed. _ frames per second). 
These features are likely related to the coiled conductor 
located inside the heating element. Note that no emissivity correction was made for this data set, so if the emissivity 
is a strong function of wavelength for this heater material then there could be an error in the temperature 
measurement. 
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Figure 11. Detailed temperature image [a] showing the location and width of the line profile displayed in [b]. The horizontal 
axis of the plot is about 20 mm long. This data is from frame number 5. Note expanded temperature scale compared to Fig. 9. 


VI. Conclusions 


A spectrally-resolving plenoptic imaging apparatus has been calibrated and demonstrated for optical pyrometry 
for the first time. Color bandpass filters were adapted to a plenoptic camera so that spectral information could be 
coded spatially on the sensor. The ratio of the intensities from the different colors was used to measure the 
temperature of hot objects. The sensor was first calibrated with a known-temperature light source and then was used 
to measure the temperature of a ceramic heater during cooldown. A limitation of the technique is that the dynamic 
range in temperature measurement is only a few hundred degrees, at least for one camera exposure setting. The 
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dynamic range can be extended by varying the camera exposure with the current apparatus. However, in future 
measurements, the dynamic range could be increased by using more filters at different colors, using color filters in 
conjunction with ND filters, or by using a sensor with a larger dynamic range. The instrument can be upgraded to 
measure many different colors simultaneously by placing additional filters in the aperture plane, leading to more 
robust measurements with a broader dynamic range. 
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